Second Renormalization of Tensor-Network States 
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We propose a second renormalization group method to handle the tensor-network states or models. 
This method reduces dramatically the truncation error of the tensor renormalization group. It allows 
physical quantities of classical tensor-network models or tensor-network ground states of quantum 
systems to be accurately and efficiently determined. 



One of the biggest challenges in physics is to develop 
accurate and efficient methods that can solve many cur- 
rently intractable problems in correlated quantum or sta- 
tistical systems. While the density matrix renormaliza- 
toin group (DMRG) has proven to be a powerful nu- 
merical tool for the study of strongly correlated systems 
in one dimension, applications to two or higher dimen- 
sions are hampered by accuracy. Quantum Monte Carlo 
simulations, on the other hand, are not limited by the 
dimensionality, but are hamstrung by the minus sign 
problem for fermionic or frustrated spin systems. To re- 
solve these difficulties, increasing interest has recently 
been devoted to the study of the tensor-network states 
or models[ll[li,i,[l. 

In statistical physics, all classical lattice models with 
local interactions, such as the Ising model, can be written 
as tensor-network models. To investigate these tensor- 
network models. Levin and Nave proposed a tensor renor- 
malization group (TRG) methodQ. They showed that 
the magnetization obtained with this method for the 
Ising model on triangular lattice agrees accurately with 
the exact result. 

In a quantum system, a tensor-network state [l|, Q 
presents a higher-dimensional extension of the one- 
dimensional matrix-product state Q in the study of 
DMRG [7]. It captures accurately the nature of short- 
range entanglement of a quantum system and is believed 
to be a good approximation of the ground state. In a re- 
cent work, we have developed a projection method to de- 
termine accurately and systematically the tensor-network 
ground state wavefunction for an interacting quantum 
Hamiltonian[3|. In the evaluation of its expectation val- 
ues, we adopted the TRG method of Levin and Navef§|. 
From the calculation, we found that the TRG can in- 
deed produce qualitatively correct results. However, the 
truncation error in the TRG iteration grows rapidly with 
the bond dimension of local tensors {D). This leads to 
a big error in the calculation of expectation values. In 
particular, the ground state energy and other physical 
quantities oscillate strongly with increasing D, indicat- 
ing that the truncation error of the TRG is too big to 
produce a converging result in the large D limit. 

In this Letter, we propose a novel renormalization 
group scheme to solve the above problem. In the TRG 



FIG. 1: Schematic representation of (a) the partition function 
of a classical system defined by Eq. ^ and (b) the tensor- 
network ground state wavefunction of a quantum system de- 
fined by Eq. (|14|l on honeycomb lattices. At each vertex, three 
bonds are emitted along x, y, and 2-directions, respectively. 



method of Levin and Nave, the singular-value spectra of 
an M-matrix defined by a product of two neighboring 
local tensors is renormalized in the truncation of basis 
space. This can be thought as the first renormalization 
to the tensor-network state. However, this renormaliza- 
tion does not consider the influence of other tensors (de- 
noted as the environment hereafter) to the M-matrix. It 
presents a local rather than global optimization of the 
truncation space. The role of environment is to mod- 
ify the truncation space by reweighing the singular-value 
spectra of M. We will introduce a systematical method 
to study this renormalization effect of environment. This 
method, as will be demonstrated below, improves signif- 
icantly the accuracy of results. We will call it the second 
renormalization group method of tensor-network states, 
abbreviated as SRG. 

To understand how our method works, let us first con- 
sider how the tensor-network state is renormalized in the 
trgQ. We start with a classical tensor-network model 
on honeycomb lattices whose partition function is defined 

by 



Z = Tr n 
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FIG. 2: (a) To form the M matrix by tracing out the com- 
mon bond indices of tensors and T*". (b) To perform the 
singular value decomposition defined by Eq. (|3}. 



tively. The subscripts Xi, yi, and Zi are the integer bond 
indices of dimension D defined on the three bonds emit- 
ted from site i along the x, y, and z directions, respec- 
tively. A bond links two sites. The two bond indices 
defined from the two end points take the same values. 

The TRG starts by rewiring a pair of tensors with sin- 
gular value decomposition as shown in Fig. [2] To do 
this, let us contract a pair of neighboring tensors to form 
a, N X N matrix M defined by 



ij.kl 
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(2) 



where TV = . The singular value decomposition is then 
applied to decouple this matrix into the following form 



N 



(3) 



where U and V are two N x N unitary matrices. A — 
(Ai, ■ ■ ■ , An) is a semi-positive diagonal matrix arranged 
in descending order, Ai>A2>--->AAr. 

The next step is to truncate the basis space and retain 
Dcut (< N) largest singular values and the corresponding 
vectors. M is then replaced by an approximate expres- 
sion 



M, 



ij,kl 



1 



The corresponding truncation error is defined by 



e(A) 



E 



TrA 



(4) 



(5) 



Eq. ([4]) minimizes the truncation error of M. However, 
it does not consider the influence of the rest of lattice 
(i.e. environment) to M . In real systems, what needs 
to be minimized is acturally the truncation error of the 
partition function Z. This means that the truncation 
error is only locally minimized by the TRgQ. For the 
spin-1/2 Ising model with D — 2, the truncation error is 
generally very small except in the vicinity of the critical 
point. However, if the bond degrees of freedom D be- 
comes large, the truncation error increases dramatically. 
This may cause a big error in the final result. 




FIG. 3: Configuration of an environment lattice (a) and that 
after one TRG iteration (b). 



To understand this more clearly, let us rewrite the par- 
tition function ((1]) as 



kl,ij ' 



(6) 



where M*^ is the contribution from the environment lat- 
tice defined in Fig. [3l is defined by tracing out all 
bond indices in the environment lattice excluding those 
connecting with the two vertices on which Af is defined. 
This formula indicates that to reduce the error in Z, one 
needs to minimize the truncation error of MM^, rather 
than that of M . 

Fig. El^a) shows the configuration of an environment 
lattice. In the rewiring and truncation of M-matrix, 
there is no need to evaluate M'' rigourously. We propose 
to evaluate M'^ iteratively using the TRG method. The 
configuration of the environment after one TRG iteration 
before decimation is shown in Fig. [3]Jb) . By contracting 
all the internal bonds connecting small triangles, a deci- 
mated environment lattice, whose configuration is similar 
to Fig. [3{a), is obtained. This iteration can be repeated 
until M'^ is converged. Generally we find that the values 
of Af^ such obtained are sufficiently accurate after 5 to 
10 iterations, the corresponding numbers of environment 
lattice sites are 2 x 3^ — 2 and 2 x 3^" — 2, respectively. 

In the minimization of the truncation error of MM*^, 
it is better to treat the row ij and column kl indices of 
AI as symmetrically as possible. To do this, let us first 
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FIG. 4: (color online) Comparison of the relative error of the 
free energy 5f{T) = \f{T)- U{T)\/ f.^T) (upper panel) and 
the specific heat (lower panel) as functions of temperature for 
the Ising model on triangular lattices obtained using TRG 
(red) and SRG. fex{T) is the exact result calculated using 
the formula given in Ref. [^. The dotted line in the Inset is 
the exact critical temperatures Tc = 4/ In 3 

do a singular value decomposition for 

where C/g and Ve are two unitary matrices and Ag is a 
semi-positive diagonal matrix. Then we can define a new 
matrix 

Af = Ay Vg^MC/eAe/^ (8) 

and show that 

Z = TrM. (9) 

Thus to minimize the error in Z , one needs only to min- 
imize the truncation error of M . 

Now let us take a singular value decompostion for M 

M = uKv^. (10) 

Again, U and V are two unitary matrices. A is a semi- 
positive diagonal matrix whose diagonal matrix elements 
are arranged in descending order. Then we can truncate 



the basis space by keeping the Dcut largest singular val- 
ues of A. By substituting the approximate M back into 
Eq. ID), one can find that 

Mij^kl « ^ S^,ijSn,kli (11) 

T! = l 

where 

ga ^ Ai/"C/U-i/V;, (12) 
S" - Ai/2l/tA-i/2c/t (13) 

are the two tensors defined in the rewired lattice. Finally 
one can follow the steps introduced in Ref. Q to update 
tensors and T'^ in a squeezed lattice by taking the 
coarse grain decimation of S"" and 5'''. This completes a 
full cycle of SRG iteration. By repeating this procedure, 
one can finally obtain the value of partition function in 
the thermodynamic limit. 

We have applied this SRG method to the spin-1/2 Ising 
model on triangular lattices. Fig. |4] compares the relative 
error of the free energy and the specific heat obtained us- 
ing the SRG with those using the TRG. The number of 
sites is B'^'^ and Dcut ~ 24. In the SRG calculation of 
M"^, 10 iterations are used. For the free energy, we find 
that the SRG can improve the accuracy for more than 
five orders of magnitude far away from the critical point, 
and more than two orders of magnitude at the critical 
point. The critical temperature Tc can be determined 
from the peak position of the specific heat. As shown in 
the Inset of Fig. IH the value of Tc obtained with SRG is 
more than two orders of magnitude more accurate than 
that obtained with TRG. Furthermore, from our calcula- 
tion, we find that the improvement of the SRG over the 
TRG becomes more and more pronounced with increas- 
ing Dcut- 

It is straightforward to extend the SRG to study 
ground state properties of a quantum system with tensor- 
network wavefunction. The two-dimensional tensor- 
network wave function can be accurately determined us- 
ing the projection approach we recently proposedjij. Af- 
ter that one can use the SRG to evaluate the expectation 
values of the tensor-network state 

To demonstrate how the SRG can improve the accu- 
racy of the expectation values of tensor-network states, 
we have applied the SRG to the Heisenberg model on 
honeycomb lattices. The ground state wavefunction is 
assumed to have the following tensor-network form 

\^) = Tr Y]_ K,>^y,K,A^iy,zA<^i\Bxjy,zA'^j] 

\a,a,). (14) 

A schematic representation of this tensor-network state 
on the honeycomb lattice is shown in Fig. mb). ai 
is the eigenvalue of spin operator Siz. A^^y^zA'^i] and 
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FIG. 5: (color online) (a) The ground state energy per site 
Eo and (b) the staggered magnetization Mstag as functions of 
the bond degrees of freedom D on honeycomb lattices. 



BxjyjZj[<^j] are the two three-indexed tensors defined 
on the black and white sublattices, respectively. A^. 
(a = x,y,z) is a positive diagonal matrix of dimension 
D. The trace is to sum over all spin configurations and 
over all bond indices. The tensor corresponding to in 
Eq. ID) is now defined by 

T'xx' ,yy' ,zz' = ^^X^x^^zY^"^ Axyzlcr] 
a 

Ax'y'z' [<y]{^x'\'^z'Y^'^ ■ 

The bond dimension of this tensor is . 

Fig. [5] compares the SRG with the TRG results for 
the ground state energy and the staggered magnetiza- 
tion for the Heisenberg model on the honeycomb lattice. 
The number of lattice sites is 2 x 3^*. The truncation 
error in the SRG calculation is less than Eq ~ 10"'^ and 
Dcut — D^- We have used the second order Trotter- 
Suzuki decomposition formula to improve the accuracy 
in the calculation of the ground state wavefunctions us- 
ing the projection approach introduced in Ref. The 
staggered magnetization is evaluated directly from the 
expectation value of the staggered spin operator in the 
ground state in the limit the external staggered mag- 
netic field approaching zero. This avoids the error in the 
determination of the staggered magnetization from the 
numerical derivative of the ground state energy at finite 
staggered magnetic field, as was done in Ref. j^. Un- 
like the TRG results, we find that the SRG results vary 
monotonically with D and tend to converge quickly to 
the infinite D limit. 

For D = 8, the SRG results of the ground energy and 
the staggered magnetization per site are respectively - 
0.5445 and 0.2142, consistent with the results obtained 
by other methods 13, U, 



The accuracy of these re- 
sults are still not comparable with those obtained by the 
DMRG[i3] and the quantum Monte Carlo method 
By considering the symmetry of the Hamiltonian, the 
tensor-network states with a bond dimension as large as 



D 20 can in principle be handled. In that case, the 
SRG results will be further improved. 

In conclusion, we have introduced a SRG method to 
improve significantly the accuracy in the TRG calcula- 
tion. This method differs from the TRG by taking into 
account the rcnormalization effect of environment to the 
M-matrix, similar as the DMRG contrasting the con- 
ventional block rcnormalization group method. For the 
classical Ising model, the relative error of the free energy 
as well as other quantities is reduced by more than two to 
five orders of magnitude when Dcut = 24 and can be fur- 
ther reduced by increasing Dcut , in comparison with the 
TRG. The SRG, in combined with the projection method 
introduced in Ref. [2], provides an accurate and efficient 
tool for exploring tensor-network ground states of quan- 
tum lattice models. It will play a more and more impor- 
tant role in the study of highly correlated systems. The 
physical idea present in this work can be also generalized 
to apply to other physical problems where the system can 
be divided into two parts and the interplay between them 
is important. In particular, if one wants to generalize the 
projection method proposed in Ref. Q to evaluate time- 
dependent or thermodynamic quantities, then the SRG 
correction to the wavefunction should be considered to 
minimize the accumulated Trotter and truncation errors 
in the iteration. 
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